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Abstract. This paper is to explore a model of the ABS Algorithms for deal- 
ing with a class of systems of linear stochastic equations A£ = rj satisfying 
rj ~ N m (v,I m ). It is shown that the iteration step a, is N(V, n) and approxima- 
tion solutions is £j ~ N n (U, S) for this algorithm model. And some properties of 
(V, 7r) and (U, E) are given. 
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1 Introduction 

It is well known, that in stochastic programming, stochastic linear equations being of 
the form 

A(w)aw) = vH (1-1) 

or 

AZ(w) = r ] (w) (1.2) 

with £,(w) r](w) are random vectors. If the constraint equation of the mathemati- 
cal programming, Ax = b contain the random variables, then the stochastic linear 



equation has the form (Id.) or Ql.2|) . 

In this paper we try explore an application of the classical ABS algorithms to solve 
system indicated by ( |1.2| ), in other words, we attempt to establish an model of algo- 
rithm, called ABS-S defined in Section 3 for solving ( |1.2| ). To this end, it is necessary 

to recall the ABS algorithms. 
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Consider the general linear systems, where rank(A) is arbitrary, 

Ax = b (1.3) 

or 

ajx = bi, i = l,---,m (1.4) 

where x G R m } b e R n } m<n and A G R mxn , A = (a 1? a 2 , • • • , a m ) T . 
The class of ABS algorithms originally for solving ( |1.3|) or (|1.4j ) was introduced by 
[AbBs84] and [AbSp89]. The iterate scheme of the basic ABS class of algorithm is 
defined as follows: 

Basic ABS Class of Algorithms: see, [AbBs84] , [AbBs89]: 

(A) Initialization. 

Give an arbitrary vector X\ G M n , and an arbitrarily nonsingular matrix Hi G 

R n,n 

Set % = 1 and iflag=0. 

(B) Computer two quantities. 
Compute 

n = r T ei = ajxi - b T ei 

(C) Check the compitability of the system of linear equations. 
If Si ^ then goto (D). 

If Sj = and = then set 

Xi_|_i X{ 

Hi + i = Hi 

and goto (F), the z-th equation is a linear combination of the previous equations. 
Otherwise stop, the system has no solution. 

(D) Computer the search vector pi G M n by 

Pi = Hjzi (1.5) 
where the parameter of Broyden, is arbitrary save that 

zjHidi ^ (1.6) 



(E) Update the approximation of the solution Xj by 

x i+ i = Xi - aiPi (1.7) 
where the stepsize on is computed by 

ai = Ti/afpi (1.8) 

If % — m stop; x m+ i solves the system. 

(F) Update the (Abaffian) matrix Hi. Compute 

H i+1 =Hi- H^wjHi/wfH^i (1.9) 
where Wi G M n , the parameter of Abaffy, is arbitrary save for the condition 

wjH iai = 1 or ^0 (1.10) 

(G) Increment the index i by one and goto (B). 

We define n by i matrices A4, Wi and Pi by 

At = (ai, ■ ■ ■ , ai) T , Wi = (wt, ■■■ , Wi), Pi = (pi, • • • , Pi) 0-H) 

Some properties of the above recursion, see for instance, Abaffy and Spedicato (1989), 
AbSp 89|1 , are listed below that are the basic formulae for use later on. 



a. Implicit factorization property 

A T iP % = Li (1.12) 

with Li nonsingular lower triangular. 

b. Null space characterizations 



AT(H t+1 ) = TZ(AJ), Af(Hf +1 ) = K{Wi, 
M{Ai) = K{HJ +1 ) 
where Af= Null and 7£=Range. 
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c. The linear variety containing all solutions to Ax = b consists of the vectors of 
the form 

x = x t+1 + Hj +1 q (1.14) 

where q G M n is arbitrary. 

This paper are organized as follows. Section 2 gives some basic definitions , operations 
that will be used below. We establish ABS algorithm of stochastic linear equations in 
Section 3. In section 4, we prove that £j, ctj have some good properties, such as £», a iy 
are both normal distributions, and give iterative formula of their expectation and 
variance. In section 5, a example is given to show the ABS algorithm of stochastic 
linear equations. In section 6 oti is discussed and same results are also given. 

2 Preliminaries 

Consider a class of systems of stochastic linear equations being of the form 

Aaw) = V (w) (2.1) 

In this paper, we give the ABS algorithm under the condition that r](w) is a Tri- 
dimensional normal distribution. And it is shown that the iteration step length ai is 
N(V, 7r) and the iteration solution £j is N n (U, E). the (V, tt) and (U, S) are determined 
by four iterative formulae. Finally, it is proven that £j + i is a solution of the first % 
equations and the step length ctj is discussed. 

Given a random experiment with a sample space Q, a function £ that assigns to each 
element u; in Q one and only one real number £(u;) = x is called a random variable. 
The space of £ is the set of real number {x : x = £(u;) E where u G f2 means the 
element a; belongs to the set il. 

If £1,^2, • • • ,£,n are the n random variable over (Q,A,V), then the vector function 
(£1, £2, • • • j £n) are is called a n-dimensional random vector are (Q, A, V). 
If £j(i = 1, 2, . . . , n) are ^(0, 1) and independent random variables, then 

?7 = (771, 772, • • • , r/ m ) T = A mn £ + // m i 

is called m-dimensional random vectors, whose probability density function or dis- 
tribution function is simply called m-dimensional normal distribution, denote 77 ~ 



N m (n, AA T ). It is easy to know that £ = 6, • • • , £n) T ~ W„(0, /„). 

Definition 2.1 is said that the random variable £ is egua/ to t/ie random variable 
7], denoted by £ = rj. if distributions of £ and 77 are the same and E£ = Erj and 
Di = D V . 

Definition 2.2 Consider the system of random linear equations A£ = rj, where rj is 
given and £ is to be found. £ is said to be a solution of this system of £ satisfies this 
system in the sense of Definition 1. 

If 

£ = ri + a,a<E7l 

then 

E£ = Eri + a,DS = Dri. 

3 ABS-S Algorithm for solving System of Stochas- 
tic Linear Equations 

Consider a system of the stochastic linear equations 

Ai = V (3.1) 
where 77 = (771, 772, • • • , r] m ) T is m-dimensional stochastic vector, A = (ai, 02, • • • , a m ) T G 

the ABS-S algorithm is defined, based on the basic ABS algorithm as follows. ABS-S 
Algorithm: for solving systems of stochastic linear equations 

(Al) Initialization. 

Give an arbitrary stochastic vector £1 e M n , and an arbitrarily nonsingular 
matrix Hi £ R n ' n . 
Set % — 1 and iflag=0. 



(Bl) Computer two quantities. 
Compute 



$i Hi CL{ 



n = a t £i~ Vi 

(CI) Check the compatibility of the system of linear equations. 
If 5, ^ then goto (D). 
If Si — and P(r, = 0) = 1 then set 

Hi+i = Hi 

and go to (F), the z-th equation is a linear combination of the previous equations. 
Otherwise stop, the system has no solution. 

(Dl) Compute the search vector pi 6 M n by 

Pi = Hjzi (3.2) 

where z iy the parameter of Broyden, is arbitrary save that 

zfH iai ^ (3.3) 

(El) Update the random approximation £j of a solution to ( |3.3| ) by 

otiPi (3.4) 

where the stepsize on is computed by 

on = -J— (3.5) 

a iPi 



If i = m stop; £ m+ i solves the system(2.1 



(Fl) Update the ( Abaffian ) matrix Hi. Compute 

H M = Hi - ^4^1 (3.6) 

wf Hidi 

where Wi G M n , the parameter of Abaffy, is arbitrary save for the condition 

wjH ia% = 1 or ^ (3.7) 

(Gl) Increment the index i by one and go to (Bl). 
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4 The properties of and ^ 

Let i] ~ N m (v, I m ),i.e, rji ~ N(vi, 1), i — 1, 2, . . . , m it is shown that the step length 
a, and the iterative solution £j obtained in the ABS-S algorithm given above. Are 
both normal distributions, that is to say. 



Theorem 4.1 

n = of 6 - Vi ~ w(af 6 - «i, i) 

Proof. From rj ~ N m (V, I m ), we know that rji ~ N(v i: 1), % — 1, 2, . . . , m. according 
to the linearity of the normal distribution, again, we see that t\ is normal distribution 

and i] ~ N(v, I m ), rji ~ N(vi, 1), % = 1, 2, m 

= £(a^i) - 
= «i 6 - Vi 

= L>(a^i) + £>(77i) 
= 1. 



Sri 



aj 6 ~ ^i 



Da x = D' " 



ajpi 



{a T lPl y 



Therefore 



a iPi «iPi { a iPi) 

n = af6 - 7/i ~ N(ai£i - vi, 1) 



The proof is completed. 
Theorem 4.2 



i2 ^ Nn{ii ~^p-r^Wp7? ] 



Proof. By using Theorem [4.1| , we have 

,alii-vi 1 



ajpi ' (a?Pi) 2 

According to the linearity of the normal distribution. Again, we see that £2 = £i — ®iPi 
is normal distribution, and 



= - a lPl ) = - E(a lPl ) 

(ajpi) 

D£ 2 = D(^-a lPl ) 



4i - £?(ai)pi = 4i ^ r x Pi 



£>(&)+ D(aiPi) 



Pi(Dai)pf 

PiPf 
(afpi) 2 



Therefore 



v t Oi^i-ui PiPf \ 
at Pi (aiPi) 



The proof is completed. 
Theorem 4.3 a^j = 0, i < j 



Proof, see ||AbBs 84|| , ||AbSp 89 



Theorem 4.4 



Ti ~ ^(Oi Ci - «i S!- =1 (J5aj)Pj - «i, 1 + a< k=1 cov(ajp j} a k p k )ai),i > 2 



Q 



Proof. The ABS-S algorithm gives rise to 



n = a i & - Vi 
6+1 = & - OtiPi 



therefore 



= a[(£i-i - oti-xpi-x) - rji 

= ~ a iPi ~ a 2P2 - ■■■ - ai-iPi-i) - Vi 

= aJi^-T.^iajPj)) -rji 

From the iterative process, we know that ctj is normal distribution, rji ~ N(vi, 1) 
hence is normal distribution, and 

Er t = Etffa-T&iaM))-*) 

= aJid-^KEa^-v, 

Dn = Dtffa 

= D(aJ(^ - T£k(a jPj ))) + D m - 2cov(aJ(^ - ^{(ajpj)),^) 

= ajD(^ - H^ipijPj))^ + 1 + 2cov(ajT l t ~} 1 (a j p j ),r] i ) 

= aJl^^DiajPj)) + T, jitk cov(a j p j , a k p k )]ai + 1 

= a J[^k=i C0V ( a jPji a kPk)}a-i + 1. 

The proof is completed. 



Theorem 4.5 



- a I ^ j= i( E ^j)Pj - ^ af[E j k=1 cov(a jPj , a k p k )}ai + 1 

on ~ A J — , J - T , i > 2 

at Pi (at Pi) 2 



Proof. According to = — = — and the linearity of the normal distribution, it is 

at Pi 



easy to known that the property holds. 
The proof of theorem is completed. 



in 



Theorem 4.6 



6+1 ~ ^(6 - E'jJ^Ea^pj, Y>\ k=1 cov{&tfj, a k p k )) 

or 

6+1 ~ N n (E£i - (Ean)pi, £>6 + piD(ai)pJ - 2cou(&, o^)), i > 2 

Proof. 

6 = 6-i - «j-iPi-i 

= 6-2 - CXi-2Pi-2 - (Xi-lPi-1 

= 6 - «lPl - «2P2 - ... - «i-lPi-l 

= 6 - sprWi- 

By = 1,2, . . .,i — 1) is normal distribution, we have 6 is normal distribution, 
and 





= £(6 






= £6- 






= 6- 






= £(6 


- Sp -1 (Q!j)Pj) 




= 


- ; mo ,),,,) 



= T 1 3 p~ 1 D(a j p j ) + Ej^coviajPj, a k p k ) 
= E J j Z]' 1 D(ajPj) + Ej-tkeoviajPj, a k p k )) 
= ^r^coviajp^akPk). 

The proof is completed. 

Theorem 4.7 6+i ^ s the solution of the fist i equations 



Proof. Because of 

6+i ~ ^n(6 - TPp^a^pj, Zl k=1 cov(ajPj, a k p k )) 

1 1 



When I < i, 



T t _ T T i 



= Vi- 

af£ i+1 = aj{ii - aziPi) 
= ajii ~ afoiiPi) 



Hence 

E(aft i+1 ) = E(af^,D(a^ t+1 ) = D(af& 
afCi+i ~N(y h l),l<i. 

The proof is completed. 

Theorem 4.8 The solution of A£ — rj is obtained in the finite steps by using ABS 
algorithm. 



Proof. According to the definition (|2.1| )of the solution of the system of the random 
linear equations A£ = rj, it is easy to see that the theorem holds. 
The proof of Theorem is completed. 



5 Example 



Stochastic linear equation 



/l 3 -1 2 0\ 

0-24100 
\0 -4 1 0-21/ 



e { 2) 
£ ( 3) 

U ( 6)/ 




(5.1) 



1 9 



t]i ~ N(6, 1), i]2 ~ iV(12,l), i] 3 ~ iV(2, 1) are independent each other. Our aim 
determining the distribution of 6 = £^ 2 \ £^ 4 \ to such that 6 

solution of equation, then we obtain the distribution of 6 using ABS-S algorithm: 
Let 



6 = (1,1,1,1,1, 1) T , #i = J 6, Zi = Oi, ^ = Oi, i = 1, 2, 3 



Then 

step 1 i=l 



n = of 6 - »7i = 5 - 77! ~ N(-l, 1) 



ai = IS" ~ ^"15' 15^ 



Pi = Hfz!, ui = ai 



6 = 6- 



10 + 77i 7/! 20-7/! 5 + 2771 



where 



15 ' 5 ' 15 



,1, 



15 



,iy ~iv 6 (?/i,<Ti) 



0"! 



H 2 = Hi — 





16 18 16 
= ( T5'15' 15' 1, 
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15 
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1/ 



13 



step 2 i=2 



90 - IO771 ~ 15772 AT( l 13 



19 2 = ^ 2 = (10,-2,4,1,0,0)' } 



r 2 90 - 10^ - 15r/ 2 1 13 

a 2 = — — = ^77 ~ JM{- 



a\%> 2 



315 



'63 3969' 



6=6" «2P2 



-740 - 121?7i + 150t7 2 190 + 4377! - 3O772 40 + 19t/i + 6O772 220 + IO771 + 15t/ 2 5 + 2r?i 



315 



315 



315 



315 



' 15 



,1) 



r 



H3 = H 2 
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H 2 a^uj 2 H 2 
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uj 2 r H 2 a 2 
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1/ 



step 3 i=3 



T~3 = 036 - 773 = 



-615 - 237t7i + I8O772 - 315773 



«3 



315 

615 + 2377/! - 180t/2 + 315t/ 3 
630 



iV(— 1.61, 1.89) 



p 3 = i#*3 = (-l,2,l,0,-2,l) T 

6 = 6- "3^3 

-865 + 4797/1 + 120t/2 + 315t/ 3 -850 - 388t/i + 300t/ 2 - 630t/ 3 -535 - 199t/i + 300t/ 2 - 315t/ 3 



= (- 



630 



630 



630 



14 



440 + 20t7i + 30r/ 2 1440 + 558j/i - 360r/ 2 + 630% 15 - 237% + 180% - 315% 
630 ' 630 ' 630 

where 



E = 



u = 


(6.47, - 


1.33, 1.97, 1.46, 2.74, 0.195) T 




f 0.525 


-1.011 


-0.331 


0.037 


0.958 


-0.475 \ 


-1.011 


1.75 


0.886 


0.007 


1.695 


0.865 


-0.331 


0.886 


0.538 


0.008 


1.015 


0.503 


0.037 


0.007 


0.008 


0.003 


-0.004 


0.002 


0.958 


1.695 


1.015 


-0.004 


1.998 


-0.99 


^ —0.495 


0.865 


0.503 


0.002 


-0.99 


0.472 / 



It is clear that the following formulae hold 

al £ 4 = %, a 2 £4 = %, of £4 = J/i 
Then £ 4 is a solution of stochastic linear equation ( p.l| ). 



6 Conclusion and Discussion 

6.1 On the step length 
Since 



Let 



ai~N( T , J - — j, ), i>2 

at Pi [at Pi) 



Then 



therefore 



Ecu = aJil - Vi 



afpi 



1 + aj H)^ =x cov{ajPj, a k p k )ai 
* — ~t~t vi 

ai ~ N(Eai,Dai) 
P{Eai - < &t < Eon + Don) = 0.6827 



P(Eai - 2Dcti <a,< Ea { + 2Don) = 0.9545 

1F> 



P{Eai - 3Dcti <a t < Ea { + 3Da t ) = 0.9973 (6.3) 
Therefore, we know that 

a, G [Eoti — 3Dcti, Eati + 3Doti\ 

that is to say, are determined by the initial vector £ 1; and the first component V\ of 
1] as well as ajpi. In the practical applications, one can chooses arbitrary are formula 
of (|6.1|) to ( |6.3| ) according to the need and the given creditable degree. 

6.2 main results 

1. system of stochastic linear equations ( |1.2| ) with 77 ~ N m (v, I m ) can be solved by 
ABS-S algorithm with the random solution £ under assumption. 

2. The solution £j generated by ABS-S algorithm is normal distribution. 

3. The step length aj generated by ABS-S algorithm is normal distribution. 

4. Since the matrix A is non-random, Hi, pi generated by ABS-S algorithm are non- 
random, thus the ABS-S algorithm to solve A£ = rj have the same properties 
as that of the basic ABS algorithm to solve Ax = b 

6.3 On problems are to be further studied 

1. The first problem are that when rj is an other distributions, whether At; = t] 
have solution and if so, whether it can be resolved by ABS-S algorithm. 

2. The second problem is that when a is random matrix, whether A£ = 77 have 
solution and if so, whether it can be resolved by ABS-S algorithm. 

3. The third problem is that when 7] is a function of random variable, problem are 
that whether A£ = 77 have solution and if so, whether it can be resolved by 
ABS-S algorithm. 
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